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Abstract 

We consider problems with multiple linear objectives and linear constraints and use Ad¬ 
justable Robust Optimization and Polynomial Optimization as tools to approximate the Pareto 
set with polynomials of arbitrarily large degree. The main difference with existing techniques is 
that we optimize a single (extended) optimization problem that provides a polynomial approx¬ 
imation whereas existing methods iteratively construct a piecewise linear approximation. One 
of the advantages of the proposed method is that it is more useful for visualizing the Pareto set. 


1 Introduction 

Multiobjective optimization problems (MOPs) have a vector valued objective function f = [/i]i<i<fc, 
where each fi is a separate objective. Often it is not possible to have optimal values for all ft si¬ 
multaneously, e.g. in portfolio optimization it is not possible to have minimum risk and maximum 
return at the same time. Another example is intensity-modulated radiation therapy, where tumour 
coverage is balanced with sparing of surrounding organs (Craft and Bortfeld, 2008; Rennen et al., 
2011). Optimization of a vector valued function involves a trade-off between two or more objectives 
fi {1 <i< k). 

A simple way to deal with multiple objectives is by assigning an importance factor > 0 to 
each objective and optimizing make the assumption that all fi should be minimized 

w.l.o.g.). If such importance factors are not known a priori, a Pareto set {PS) allows the decision 
maker to make the trade-off after optimization. The set PS consists of all objective vectors f 
in which one or more objectives can not be improved without deteriorating one or more other 
objectives. Overviews of MOPs and approximation methods can be found in (Branke et al., 2008; 
Ehrgott, 2005; Miettinen, 1999). 

In practice often approximations of PS are used, since the exact PS can often not be found. 
In literature many different approximation methods are proposed. It is desirable to approximate 
PS with as few optimization runs as possible (Rennen et al., 2011). A well-known class of such 
approximation methods is sandwich methods. Sandwich methods (Rennen et al., 2011) produce 
piecewise linear approximations in which between PS is located. In each iteration an optimization 
problem is solved, which leads to adding one or more facets to the approximations. All other 
methods (again see (Branke et al., 2008; Ehrgott, 2005; Miettinen, 1999)) are also sequential, i.e. 
in each iteration one has to solve an optimization problem which leads to an improvement of the 
approximation. 
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In this paper, we focus on approximating PS for linear programming and propose a totally dif¬ 
ferent way than those in the literature. The first difference is that our method is not sequential, but 
generates the approximation by solving one extended optimization problem. The second difference 
is that the final approximation is not piecewise linear but a polynomial. The way we construct 
this approximation is by using techniques from Adjustable Robust Optimization (ARO) (Ben-Tal 
et ah, 2009) and Polynomial Optimization (Laurent, 2009). We first explain the link to ARO. The 
Pareto set is seen as a function of the uncertain parameters /i,..., fk-i- The area of interest, i.e. 
the domain for /i,..., fk-i for which we would like to approximate the Pareto set, is considered as 
the uncertainty region. All variables in the linear program are made adjustable in the parameters 
/i, ...,fk-i. We use polynomials for the decision rule, and use Polynomial Optimization theory to 
reformulate the resulting robust counterpart into a Semi-Definite Programming (SDP) problem. 
Since the number of uncertain parameters (i.e. k — 1) is often low, the sizes of the LMIs in the 
SDP are relatively small. Notice that in our approach ARO is merely used as a tool, uncertainty 
in the data is not considered. 

The approach proposed in this paper has the following advantages: 

The first advantage is that the final approximation is more tractable for navigating through 
PS. The polynomial representation is useful for the user to visualize PS for selecting the final 
solution. This is the reason why in (Goel et ah, 2007), afer determining points in the feasible 
region close to or on PS, polynomial regression is used to obtain a tractable representation of PS 
(a so-called response surface). Our method finds such a tractable representation directly, with the 
additional advantage that it is guaranteed to lie in the feasible region. Sometimes the decision 
maker needs a local approximation of PS around a given solution. Zhang et al. (2000) formulate 
and test a method that gives a local quadratic approximation of (not necessarily convex) PS, but 
this approximation is neither an inner nor an outer approximation. Our method gives a polynomial 
of arbitrary degree and is guaranteed to give an inner approximation. 

The second advantage is that our approach can be used to certify with a single optimization 
run that a given set V is dominated, i.e. that all elements of the set are dominated. If our method 
finds a feasible solution, then this solution is a certificate that the set V is dominated. 

The third advantage is that the explicit polynomial approximation can be used in optimization 
problems with Pareto constraints. Such problems contain constraints that enforce that the solution 
should be (near) Pareto optimal for a certain multi-objective linear program. Examples of these 
problems can be found in e.g. (Hackman and Passy, 2002). A Pareto constraint can be replaced 
by the explicit polynomial approximation found by our method. 

The fourth advantage is the possibility to quickly determine the shape of PS. (Craft and 
Bortfeld, 2008), e.g., show that in IMRT the set of feasible objective vectors is often “long and 
narrow” and therefore a linear approximation of PS suffices. This linear approximation can be 
easily obtained by our approach. Finally, after an initial approximation, the most interesting 
subregion can be selected, followed by one or more iterations of approximation and selection. An 
interesting subregion can also be used as input for another algorithm that explores it more carefully. 

This method also has five disadvantages. First, the resulting problem is often an SDP while 
the original problem is LP. Only in case the approximation is linear and the region of interest is 
polyhedral, the resulting problem is LP. Note that this is still an interesting case; see (Craft and 
Bortfeld, 2008) that uses linear approximations in IMRT problems. Second, our method requires the 
region of interest to be known. Sandwich algorithms are capable of exploring the region of interest 
(Rennen et ah, 2011). Third, it is difficult to approximate the Pareto set at its vertices, because 
polynomials are smooth functions. The further the vertex angle from 180°, the more difficult it is to 
approximate it. However, in some cases a smooth approximation is desirable, see e.g. (Mello et ah, 
2002). Fourth, the method can not be extended to nonlinear multiobjective problems with current 
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ARO technology. Methods for approximating nonlinear MOPs can be found in (Luque et ah, 2012; 
Utyuzhnikov et ah, 2009). Fifth, while we show (Appendix A) that the method can also produce 
outer approximations, this is practically impossible due to computational issues. 

2 Notation 

We use the notation from (Rennen et ah, 2011) with some minor changes. 

Throughout this paper, we use the following orderings of vectors. Let x,y ^ M” with n > 
2. With Xj, we denote the element of the vector x. To enumerate different vectors, we use 
superscripts. When ordering two vectors, we use: 

• X < y Xi < yi for alH = 1,..., n. 

• X ^ y Xi < yi for alH = 1,..., n and x ^ y. 

• X < y Xi < yi for alH = 1,..., n. 

The symbols >, ^ and > are defined accordingly. We furthermore define the set M” = {x G M"" : 
X < 0}. If X C M"-, then we define X + = {x + y : x ^ X,y ^ M”}. The sets and X + 

are defined accordingly. 

In this paper, we consider the following multi-objective optimization problem: 

min f{x) = [{c^fx,...,{c'^fx]'^ 

Ax < b, 

where x G MA is the optimization variable, c* G MA are the objective vectors, and A G and 

b G M™. 

As it is generally impossible to find a feasible x that minimizes all objectives at the same time, 
our aim is to find a set of so-called Pareto optimal solutions. 

Definition 1 

An objective vector f{x), for x such that Ax < b, is (strongly) dominated if there exists an x such 
that Ax < b and f{x) < f{x). If no such x exists, the objective vector f{x) is weakly Pareto 
optimal. 

An objective vector f{x), for x such that Ax < b, is weakly dominated if there exists an x such 
that Ax < b and f{x) ^ f{x). If no such x exists, the objective vector f{x) is (strongly) Pareto 
optimal. 

The set of Pareto optimal solutions is denoted by PS. An inner and outer approximation of 
the Pareto set are defined as follows: 

Definition 2 A set IPS C is an inner approximation of PS if it satisfies IPS Q PS 

Definition 3 A set OPS C is an outer approximation of PS if it satisfies PS Q OPS 

We will approximate PS with polynomials on multidimensional sets. The following definitions are 
used to define the degree of a polynomial. 

Definition 4 A monomial of degree d in x G with powers a G M"" such that Y)a=i = d, is 
defined by lli=iXih 

Definition 5 A polynomial of degree d in x £ M” is defined as the sum of monomials in x of 
degree up to d. The degree of a polynomial f is denoted as deg{f). 
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3 Inner approximation 

Let U C be the domain of interest for 

((c^) x,{c?) a;,..., (c^“^) a;). For a fixed in [/, the following optimization problem determines 
a single weakly Pareto optimal solution (Miettinen, 1999, Thm. 3.2.1): 

mm (c ) X 

X 

(c*)^a; <Ui i = 1,2,..., /c — 1 

Ax < b. 

If the solution x is unique, it is (strongly) Pareto optimal (Miettinen, 1999, Thm. 3.2.4). For 
every u, there will be a different optimal x. So, we want to solve for x as a function of u. The 
constraints should hold for all x{u) for which u is in U, and the goal is e.g. to minimize the average 
objective: 

min f {c'^ fx{u)du (la) 

x(u) Jjj 

x{u) < Ui yu G U, i = 1, 2,...,/c — 1 (lb) 

Ax(u) < b \fu G U. (Ic) 

This is an ARO problem, where u is the uncertain parameter, U is the uncertainty region, and x 
is an adjustable variable Ben-Tal et al. (2009). It is difficult to optimize over functions, therefore 
ARO uses parameterized functions for adjustable variables. The adjustable variables then become 
expressions that are linear in the parameters. For instance, if we take a linear parameterization 
x{u) = Q:° + the parameters are a® G M"" and G After substituting x{u) in 

the problem (la)-(lc), an ARO problem with constraints that are linear in and remains. In 
general, the tractability of (la)-(lc) depends on the class of functions considered for x and the set 
U. Given a solution to this optimization problem, an inner approximation is given by 
{((c^) x(u),{c^) x{u), x{u)) : u G U'\. Constraint (Ic) ensures that x{u) is feasible. 

So, the resulting inner approximation indeed lies in PS + M^. The objective (la) minimizes the 
volume under the inner approximation if (lb) is tight for all u . Note that a constant function x{u) 
may be feasible for this optimization problem. The reason why this problem returns an interesting 
inner approximation and not just a constant function x is because from the objective it follows 
that a smaller (c^) x{^u) is better, and a smaller (c^) x(u) can only be obtained by increasing 
x(u) for i = 1,2,..., A: — 1. This increase as a function of u is constrained by (lb). 

A functional description of the inner approximation may be more tractable for a specific purpose. 
Therefore, we define: 

IPS = {{u, (c'^fxiu)) :ugU}. 

If constraint (lb) is tight for all u, IPS is the same as the inner approximation given before. 
Otherwise, the given inner approximation dominates IPS. 

The question arises for which regions U and functions x this formulation is tractable. When 
U is polyhedral, for instance a box {{u G : ||ri||oo — 1})) x is linear in u, this problem 

can be formulated as an LP. The optimization problem minimizes the volume enclosed between the 
linear approximation, the Pareto curve and the boundary of U. In case of two objectives (/c = 2), 
it will find the line connecting the point on the Pareto curve where (c^)^® = — 1 with the point 
on the Pareto curve where x = 1. Hence, it finds two Pareto optimal points. This extends to 
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larger k, where it finds a plane going through k — 1 Pareto optimal points. In case U is a box, the 
instance size also grows linearly in k. This result of linear growth is new, because determining a 
linear inner approximation over a box would require determining the Pareto optimal points at the 
exponentially growing number of extreme points of U. 

The inner approximation becomes more interesting when x is nonlinear in u. When k = 2, a 
tractable choice is given by polynomials: for polynomials of arbitrarily large degree, the problem 
can be formulated as an SDP (Ben-Tal et ah, 2009, Lemma 14.3.4), for which polynomial time 
solvers are available. When k > 2, the problem is tractable when U is ellipsoidal and x is quadratic 
in u (Ben-Tal et ah, 2009, Lemma 14.3.7). The resulting problem is an SDP with m+k — 1 variables 
matrices of size k + 1 and m + k — 1 constraints. 

For k > 2, the problem can also be reformulated as an SDP when U is a semialgebraic set {U = 
{u : Pi{u) <0 (i G /)}, where pi are polynomials of arbitrary degree), and a; is a polynomial in u, 
but the reformulation is not always equivalent. This means that the resulting optimal solution for 
the SDP reformulation may not be optimal for (la)-(lc). However, the solution to the reformulation 
is always an inner approximation, and the numerical results in Section 4.2 are promising. The 
reformulation is based on polynomials that are sums of squares (SOS) of other polynomials. An 
example of an SOS polynomial is 5x'^ + 2x + 65, because it can be decomposed as (2x4-4)^-|-(x —7)^. 
Testing whether a polynomial is SOS is equivalent to solving an SDP (Laurent, 2009, Lemma 3.8) 
with a matrix of size where k — 1 is the number of variables and d is the degree of the 

polynomial. An SOS polynomial is obviously nonnegative. Let us focus on constraint (lb): 

ui — {c^) x(u) >0 Vii : Pi{u) <0 (i G I). 

By applying Putinar’s Positivstellensatz (Laurent, 2009, Thm. 3.20), which has been done before 
in ARO Bertsimas et al. (2011), we can obtain a sufficient condition under which this constraint 
holds: 

ui - {c^fx{u) = ao{u) -4 '^pi{u)ai{u), (2) 

i£l 

where ao and ai (i G I) are SOS. Solving a problem with constraint (2) instead of (lb) is conservative 
for two reasons. First, (2) may not be a necessary condition when there are no cto, cj* that are SOS 
for which the set {u : ao{u) + '^i^iPi{u)ai{u) > 0} is compact, or when (lb) is a not a strict 
inequality. Compactness can easily be guaranteed by including a constraint u? — ii < 0 to 

the description of U, which can be done without changing U because U is bounded (Laurent, 2009, 
p. 186). However, (lb) will in general not be a strict inequality. Second, solving a problem with 
constraint (2) as an SDP requires bounding the degree of ao and ai. 

We let the degree of x determine the complexity of the problem unless g is of higher degree, 
so we take the degree of ao equal to max{deg{x),maxi{deg{gi)}}, and the degree of ai equal to 
max{0,deg{ao) - deg{gi)}. 

An overview of all tractable cases is given in Table 1. 

For many uncertainty regions it may be difficult to reformulate the integral in the objective 
function as a simple linear function in the optimization variables. In that case the objective can 
be replaced with the average value of (c^) x(u) at well distributed sampling points u in U. For 
efficient sampling from a polytope, see e.g. Kannan and Narayanan (2009). 

The user has to specify the domain of interest U. If the specified region is too large, two things 
may occur. First, U may contain a vector with objective values that are too optimistic in the 
sense than they can not be met, in which case constraint (lb) is infeasible. Second, U may contain 
objective values that are not weakly dominated by f{x) for any feasible x. In that case constraint 
(lb) will not be tight and also the objective is not fully related to the area of interest. 
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Table 1: Tractability of the inner approximation. 


k 

U 

x{u) 

Tractability 

Exact 

> 2 

box 

linear 

LP 

V 

> 2 

polyhedral 

linear 

LP 

V 

> 2 

ball 

linear 

CQP 

V 

2 

interval 

polynomial 

SDP 

V 

> 2 

ellipsoidal 

quadratic 

SDP 

V 

> 2 

semialgebraic 

polynomial 

SDP 

- 


When the number of objectives is three or more, a weak parameterization of x can be another 
cause of infeasibility. If feasible solutions exist for all u in U, it is possible that these solutions 
can not be attained with the parameterization. An easy example is the case where U contains two 
different Pareto optimal solutions (projected on the first k — 1 coordinates) while x is a constant 
function. When the optimization problem is infeasible, we do not see a possibility to detect whether 
the parameterization is too weak or U contains infeasible points. 

It is known that PS is convex, and that it is nonincreasing. It may be the case that these proper¬ 
ties do not hold for the inner approximation, which is problematic when the inner approximation is 
used in an algorithm that assumes these properties to hold. In case x is linear in u, these conditions 
are automatically satisfied. In case k = 2, u is one-dimensional and convexity and nonincreasing- 
ness of (c^) x{u) can be enforced by constraining the first and second derivative w.r.t. u. The first 
and second derivative of a polynomial is again a polynomial, so constraining these to be negative 
and positive, respectively, for polynomial x does not increase the complexity class of the problem. 
In case k > 2, U is a polynomial and x is quadratic in u, say x{u)i = + (^^j) u + u F^u where 

G M, G and Tj G are decision variables. Nonincreasingness can easily be 

enforced by adding the constraints ol\ + 2TiU <i) for all u in U, which is a set of n{k — 1) linear 
constraints with ellipsoidal uncertainty, each of which can be reformulated as a conic quadratic 
constraint. For convexity it is required that Tj is positive semidefinite, which is an SDP constraint. 

4 Numerical examples 

4.1 Two objectives 

We construct a semi-random 150 x 170 matrix A, a 150-vector b, and two 170-vectors and c^, 
such that the Pareto cuve is interesting on the interval [0,25]. We compute a polynomial inner 
approximations of degree up to 16. 

We solve linear programs with Matlab linprog. We enter linear constraints with LMI uncertainty 
into YALMIP Lofberg (2012). YALMIP reformulates this problem as an SDP. In Appendix B we 
show how to do this reformulation by hand in case of a polynomial of degree 3. We let YALMIP 
export the resulting problem, then we reformulate free variables as the difference of two nonnegative 
variables using CSDP’s convert!, and solve the problems with SDPA Yamashita et al. (2010) (SDPA- 
DD Nakata (2010) for the problem with a polynomial of degree 16). Figure 1 shows the resulting 
solutions. The solution time ranges from 21 seconds for the polynomial approximation of degree 4 
to 4 minutes for degree 8 (with SDPA), and 45 minutes for degree 16 (with SDPA-DD). 
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(c) degree 8 (d) degree 16 


Figure 1: Numerical example with two objectives indicating the quality of the inner approximation 
with a polynomial decision rule. The lowest curve represents the set PS which is usually not known. 

4.2 Three objectives 

We semi-randomly construct vectors G [0,1]^^, G [0,1]^° and G [—1,0]^°, and take Mi*).® 
as the feasible region. Recall from Table 1 that we have an exact result for a quadratic inner 
approximation over an ellipsoidal set, and a conservative result for polynomial inner approximations 
of arbitrary degree over semialgebraic sets. Again we use YALMIP and SDPA to formulate the 
problem and solve the resulting SDPs. We use YALMIPs SOS module for constraining an expression 
to be SOS. 

We take {ri : | — 5| I 2 < 5} as the area of interest for (c^) x and (c^) x, and approximate the 

Pareto set with a polynomial of degree 2 and with a polynomial of degree 4. For degree 2, we solve 
the exact robust counterpart, while for degree 4 we solve the SOS approximation. We also solve the 
SOS approximation for degree 2, and notice that the inner approximation is the same as with the 
exact robust counterpart. Figure 2 shows that the polynomial of degree 4 gives an approximation 
that is closer to PS than the polynomial of degree 2. The solution time is around 1.6 seconds for 
all three approximations. 

A Outer approximation 

In this appendix we show how ARO can be used to construct an outer approximation. While 
theoretically possible, it is practically not tractable to determine polynomial approximations of 
degree 2 or higher due to computational issues. For linear approximations, the results are trivial. 
We still mention the result because it also uses ARO to approximate PS. 

Let U = [a^,6^] x [a^,6^] x ••• x with [a*, 6*] be the domain of interest for (c*) x 

{i = 1,2,k — 1). We construct the set OPS by creating a function function £ : —)■ M for 
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(a) degree 2 (b) degree 4 


Figure 2: Numerical example with three objectives indicating the quality of the inner approximation 
with a polynomial decision rule. The lowest set represents the set PS which is usually not known. 

which ..., , i{u^, ,..., u^~^)) is in PS + and optimizing over this function: 

max / £{ui,U 2 , ■ ■ ■ ,Uk-i)du 

i Ju 

S.t. (c^)^ X, . . . , (c^“^)^£c) < 

V® : Ax < h, a* < (c*) x <P. 

Given a solution to this optimization problem, the outer approximation is 
{{ui,U 2 , ■ ■ ■ ,Uk-i,i{ui,U 2 , ■ ■ ■ ,Uk-i)) : u G U}. The objective (3a) maximizes the volume under 
this approximation. Constraint (3b) ensures that the outer approximation as a function of (c^) x 
lies under (c^) x for every x in the domain of interest. 

An optimal outer approximation is tangent to the Pareto curve at (at least) one point. This 
becomes clear from (3b): this constraint holds with equality for at least one x because otherwise 
we can add a constant to i without losing feasibility, which contradicts optimality. Previous results 
force the decision maker to specify either this point of tangency or the derivative at this point a 
priori. Our formulation determines the point of tangency in such a way that the volume enclosed 
between this linear outer approximation and the Pareto curve over the set U, but in the linear case 
this turns out to give a trivial result. 

When I is linear, the problem (3b) can be reformulated as an LP using ARO. For the case 
k = 2 (two objectives) it can be shown that the optimal linear £ is a line tangent to PS at ° , 

i.e. halfway the interval of interest. We conjecture that in higher dimensions the point of tangency 
is the barycenter of U. This would imply that the formulation for the outer approximation is not 
interesting because it is already known how to obtain an outer approximation that is tangent at a 
given point. 

For nonlinear I the SOS framework used in Section 3 can be used to reformulate the problem as 
an SDP when is a polynomial of arbitrary degree d. This is a polynomial in the vector x, so the 
number of terms is ("')^'^), which is also the order of the matrix in the SDP. Even for a quadratic 
function, the size of the SDP is often too large to solve. 

The user has to specify the domain of interest [u^,u‘^]. Specifying the wrong domain does not 
lead to infeasibility. However, if the interval is too large, i.e. (c^) x does not range through the 
full interval, part of the outer approximation is meaningless because PS is inexistent for some u. 
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(3a) 

(3b) 





B Derivation of the SDP formulation for a polynomial inner ap¬ 
proximation with two objectives (online supplement) 

We give a derivation of the SDP formulation of (la)-(lc) in case x{u) = qq + a-^u + a 2 V? + 
(where ctj in i=l,2,3) for the numerical example of Section 4.1. Suppose the area of interest 
for is [0,25], then u runs from 0 to 25. Because in the result by (Ben-Tal et ah, 2009, 

Lemma 14.3.4) u runs from -1 to 1, we use the following linear transformation x —)■ Dx + d to 
transform Z = {{u,u^ ,u^) : —1 < m < 1} into {{u,u^ ,u^) :0 <u< 25}: 



( 12.5 

0 

0 ) 


( 12.5 \ 

D = 

312.5 

156.25 

0 ' 

d = 

156.25 


^5859.375 

5859.375 

1953.125) 


(1953.125) 


The problem can now be written as follows: 


where: 


mm (c ) (25q:o + 

(c^)^ (qo + [«! 02 as]{DC + d)) < {DC + d)i 

VC G ^ 

A(q;o + [q:i Oi2 a3]{DC + d))<b 

VCg^, 


Z = {C G 



A 0 0 o\ 

T 

Ao\ 

0200 


Ai 

3 0 4 0 


A 2 

0 4 0 8 


A 3 

3 0 4 0 


A 4 

0 2 0 0 


As 

yl 0 0 Oy 


vAe/ 


/ Ao 

Ai 

A2 

A3\ 

Ai 

A2 

As 

A4 

A2 

A3 

A4 

As 

\A3 

A4 

As 

As) 


(4a) 

(4b) 


Constraints (4a) and (4b) are a total of 151 semi-infinite constraints that have to hold for an 
infinite number of C- Let Aj denote the row of A. In order to allow for shorter notation, we 
define the linear function £ : x x —)■ vector £{a) := Aj[oL\ a .2 ols]D. The 

constraint of (4b) can be rearranged to: 

AjOLQ — b + [oL\ 0.2 as]d + i{a)C<0 VC G .Z, 

which is equivalent to: 


Ajao — b + [ai 02 ctajd-|-max {.£(q;)C} < 0. (5) 

CS.Z 

The maximization problem is an SDP. Replacing this problem with its SDP dual and omitting the 
min operator is a well-known method to transform a semi-infinite constraint into a single constraint. 
We show how to do this. In the following SDP, we take the 4x4 matrix with Aj’s in the description 
of Z as our variable X. Let £i{a) denote the component of t{o). 
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The optimization problem in (5) is: 


max (C, X) 

s.t. {Ai,X) = bi (i = l,2,3,4) 

X ^ 0, 

where (•, •) denotes the trace inner product, 5i = 1 , 62 = ^3 = ^4 = 0 , and: 


/4(a) 

4(a) 

5 (a) 

4(a)^ 

4(a) 

5 (a) 

4(a) 

g{oi) 

5 (a) 

4(a) 

5 (a) 

4(a) 

\4(a) 

5 (a) 

4(a) 

4(a)/ 


with g{a) = -£i(a) +£ 3 ( 0 ;), and: 
3 





/O 

0 

0 

2^ 


/o 

0 

1 

2 

0\ 




0 

0 

2 

0 

, A2 = 

0 

1 

0 

0 

Ai 



0 

2 

0 

0 

1 

2 

0 

0 

0 





0 

0 

V 



0 

0 

0; 


/ 

0 

0 

0 


-A 


/O 

0 

0 

0 \ 

A3 = 


0 

0 

1 


0 


0 

0 

0 

_ 1 


0 

1 

0 


0 

, A4 = 

0 

0 

1 

2 

0 


1 

-1 0 

0 


0 J 


lo 

1 

2 

0 

0; 


By formulating the dual and putting this into constraint (5), we get the following robust counterpart: 

Ajao-b + [a.i_ 0L2 a3]d + yi<0 

4 

yiAi - C ^ 0. 

i=l 

Constraint (4a) and the other constraints (4b) can be transformed in a smilar way. 
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